Skip to content

[ci] Group Windows Playwright tests by runtime - #2

Draft
starsling-dev wants to merge 1 commit into
mainfrom
starsling/ci-group-windows-playwright
Draft

[ci] Group Windows Playwright tests by runtime#2
starsling-dev wants to merge 1 commit into
mainfrom
starsling/ci-group-windows-playwright

Conversation

@starsling-dev

Copy link
Copy Markdown
Owner

Temporary benchmark PR for measuring grouped Windows Playwright job timing. Not intended for merge.

The `playwright-windows` job sharded the whole CLI e2e suite across two
shards, but the dev-server suites in `e2e/playwright/dev` dominate
Windows runtime. Because Playwright keeps `describe.serial` blocks on a
single shard, count-based sharding of the mixed suite left one shard at
~20m while the other finished in ~5m.

Split the slow `dev` directory across three `--shard` jobs and run the
faster `prod` suite on its own, reusing the same `--shard` mechanism as
the Ubuntu Playwright job. This drops the Windows Playwright test-step
long pole from ~20m to ~8m with the same total test coverage. Sharding
by directory keeps newly added test files covered automatically.
@starsling-dev
starsling-dev force-pushed the starsling/ci-group-windows-playwright branch from 431dbfc to f148370 Compare July 2, 2026 07:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants